The Annals of Applied Probability 

2006, Vol. 16, No. 3, 1411-1431 

DOI: 10.1214/105051606000000268 

© Institute of Mathematical Statistics, 2006 



TAIL ASYMPTOTICS FOR THE MAXIMUM OF 
PERTURBED RANDOM WALK 

By Victor F. Araman and Peter W. Glynn 

New York University and Stanford University 

Consider a random walk S = (S n : n > 0) that is "perturbed" by a 
stationary sequence (f n : n > 0) to produce the process (S n + £n : n > 
0). This paper is concerned with computing the distribution of the 
all-time maximum = max{Sfc + : k > 0} of perturbed random 
walk with a negative drift. Such a maximum arises in several different 
applications settings, including production systems, communications 
networks and insurance risk. Our main results describe asymptotics 
for P(Moo > x) as x — » oo. The tail asymptotics depend greatly on 
whether the £ n 's are light-tailed or heavy-tailed. In the light-tailed 
setting, the tail asymptotic is closely related to the Cramer-Lundberg 
asymptotic for standard random walk. 

1. Introduction. Let S = (S n : n > 0) be a random walk sequence, so that 
So = and S n = X\ + • • • + X n for n > 1, where X\,Xz, ■ ■ ■ define an i.i.d. 
sequence of random variables. We set EXi = fi. We shall generally assume 
that the random walk has negative drift. Given a sequence (£ n : n > 0) of 
"perturbations," we call the process (S n + ^ n : n > 0) a "perturbed random 
walk." This paper is concerned with developing limit theorems and related 
approximations for P(M tX3 > x), where M m is the all-time maximum 

Mqo = max{5' fc + £ fc : k > 0}. 

Perturbed random walks have been previously studied within the insur- 
ance risk theory literature; see, for example, [7, 16, 17]. The existing liter- 
ature typically assumes that the perturbation sequence (£„ : n > 0) is itself 
of random walk type. However, in this paper, we shall instead assume that 
the perturbations (£ n : n > 0) form a stationary sequence, so that the large- 
time behavior of the sequence (S n + £ n :n > 0) is basically inherited from 
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that associated with S itself. Such perturbed random walks (with station- 
ary perturbations) arise naturally in several different applications settings. 
In Section 2, we argue that M m describes the steady-state order-to-delivery 
time in a make-to-order production system, in which delays are incurred at 
the production facility due to supplier tardiness in component delivery. The 
quantity also arises in the modeling of end-to-end delay of data packets 
in a telecommunications network, as well as in computing ruin probabilities 
for an insurance firm in which delayed premium payment occurs; see, for 
instance, [1]. 

Perturbed random walks bear some resemblance to the process studied 
within the nonlinear renewal theory literature; see [12, 13, 19] for a discus- 
sion of the main results. However, nonlinear renewal theory presumes that 
the perturbations are uniformly continuous in probability, in the sense that 
max{|£ n +fc — £ n | : < k < n5} converges to zero in probability as n — > oo. 
This continuity condition is clearly violated by the i.i.d. perturbations that 
are a central example in our theory. Additional related literature includes 
[10], in which first passage times for perturbed random walk with positive 
drift are analyzed, as well as [8] and [9]. The latter two references obtain 
approximations for the tail of when the £ n 's are constant after a finite 
number of steps (and hence satisfy the uniform continuity in probability 
hypothesis). 

The all-time maximum of our perturbed random walk inherits char- 
acteristics related to the all-time maximum max-fS^ : k > 0} of ordinary 
random walk and from the extreme value behavior of the perturbations 
(^k'k>0). Thus, the theory we develop here exhibits new features that are 
not present in the context of either nonlinear renewal theory or the per- 
turbed random walks previously considered in the literature. In particular, 
it turns out that the tail behavior of the perturbations interacts with the 
(unperturbed) random walk in a nontrivial way to produce the tail behavior 

Of Moo. 

We establish the following results for the all-time maximum M^: 

1. We find an integral equation satisfied by the distribution of and 
characterize its solution (Proposition 3). 

2. When the perturbations are light-tailed, we obtain exact asymptotics for 
P(Moo > x) as x — > oo, under conditions closely related to those of the 
Cramer-Lundberg tail asymptotic for unperturbed random walk (Theo- 
rems 1 and 2). 

3. For heavy-tailed perturbations, we obtain exact asymptotics for P(M 0Q > 
x) as x — > oo (Theorems 3 and 4). 

We should note that under some regularity conditions, the results of 
Propositions 1, 2 and 6, as well as Theorem 4, hold not only for a ran- 
dom walk with i.i.d. increments, but also for a generalized random walk 
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where the increments X form a stationary sequence (see [1] for more de- 
tails). Furthermore, in the presence of light-tailed perturbations and under 
weak conditions on the underlying (generalized) random walk, we can also 
prove an asymptotic for logP(M 00 > x) as x — > co (we again refer the reader 
to [1] for more details). 

Araman and Glynn [2] develop related results for the distribution of 
when the random walk S has a negative drift close to zero, so that diffusion 
approximation techniques can be applied. 

This paper is organized as follows. Section 2 focuses on a motivating 
example and basic properties of perturbed random walk, while Section 3 is 
concerned with developing asymptotics for P(Moo > x) when the £ n 's are 
light-tailed. Section 4 is devoted to heavy-tailed perturbations. 

2. A motivating example and basic properties. Several models exist in 
which perturbed random walks arise naturally. We provide here a production 
model and direct the reader to [1] for a discussion of telecommunications and 
insurance risk examples. 

Example. Consider here a model of a so-called "make-to-order" pro- 
duction facility, which incorporates possible delays in the arrival of sup- 
plier components. Incorporating such delays is an important modeling issue 
and has been previously addressed by many authors, such as Kaplan [11], 
Sahin [15], Zipkin [20] and many others, using different modeling approaches 
than those we shall now describe. 

For the purposes of our model, let A n be the time at which the nth order 
to the production facility is placed, so that A = (A n : n > 0) is nondecreasing. 
The facility satisfies demand according to a "first-come, first-served" priority 
rule, so that the nth order is processed to completion prior to initiating the 
(n + l)st order, for n > 0. As soon as an order is placed, the production 
facility contacts its supplier. The supplier provides to the production facility 
the components necessary to produce the nth finished item after a delay of 
duration rj n , so that the corresponding components arrive to the production 

facility at time A n = A n + rj n . Thus, we are modeling a "just-in-time" facility 
in which delays may be a consequence of transportation time, the time 
required to produce necessary components at the supplier facility, or some 
combination of these factors. Note that the sequence A = {A n : n > 0) need 
not be nondecreasing. Although the production facility satisfies customer 
demand according to the original order sequence, component deliveries to 
the producer may occur in an order that differs from this original ordering. 
This possibility differentiates our model from previous work on supply delay 
issues. Most of the references mentioned earlier model stochastic supply 
leadtimes as being either exogenous quantities (independent of the arrival 
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process and the processing time) or endogenous in the sense that they are 
determined by an embedded queueing system. In both cases order-crossovers 
are not allowed. 

As indicated above, customer demand is satisfied according to the origi- 
nal order sequence. This assumption is realistic in settings where customer 
equity concerns and total-order-to-delivery time issues predominate. Note, 
however, that, under this assumption, the production facility is no longer a 
"work-conserving" system (in the sense that the facility may be idle with 
orders present). If D n is the time at which the production facility completes 
work on the nth order, this assumption guarantees that the production fa- 
cility initiates processing on the (n + l)st order at the maximum of D n and 
A n+ i. Let V n+ \ be the processing time required for the (n + l)st order, W^+i 
the time that an order spends waiting in the production facility and W n the 
total time spent in the system, so that W n = W n + r] n . A simple argument 
shows that 

(2.1) W n+1 = max(W n + A n - A n+1 + V n ,0). 

Thus, we recover the familiar Lindley recursion (2.1) (for single server queues), 
even though we are not requiring here that A = (A n : n > 0) be nondecreas- 
ing. Let Z n+ \ = A n — A n+ \ + V n for n > and assume, for simplicity, that 
the production facility is idle at time t = 0, and that the 0th order arrives 
at time Aq = 0. Then (as is usual for the Lindley recursion), it is easily seen 
that 

(2.2) W n = max| z j + Vk - Vn'-O < k < n\ . 

[j=k+i J 

Proposition 1 depicts the steady-state behavior of W n as n — > oo. 

Condition Al. ((Z n ,rj n -i) :n > 1) is a sequence of i.i.d. random vec- 
tors. 

Let ((Z n ,ry n _i) : — oo < n < +oo) be a two-sided version of ((Z n ,n„_i) : 

n > 1) and set X n = Z_ n , £ fe = and S n = X\ + X 2 H 1- X n for n > 1 

with So = 0. It is then easy to see that 

PROPOSITION 1. Under Condition Al, W n =^ as n^+oo, where 
M oo = mnx{S k + £ k :k>0}. 

Because total order-to-delivery time is a key performance characteristic 
for a production facility, it follows that computing the distribution of 
is important, where 

M n = maxjSfc + : < k < n}. 
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We list below some basic results for which we have omitted the proofs; for 
the details, see [1]. Set & = max(£j,0). 

Proposition 2. Suppose that (Xj :j > 1) is a sequence of i.i.d. random 
variables such that KXi = \i, where — oo < \i < 0. 

(i) If (£j :j>0) is an identically distributed sequence with E£^~ < oo, 
then Mqo < oo a.s. 

(ii) If (£j : j > 0) is a sequence of i.i.d. random variables, then < oo 
a.s. implies that E£+ < oo. 

To compute the exact distribution of Mqo, define, for g:M— > M + , the 
linear operator T via 

(Tg){x)= f g(x-y)F(So<x,X 1 €dy). 

JR 

Also, let T° be the identity operator and define T n inductively via T n+l = 
ToT n for n > 0. 

Proposition 3. Suppose that ((£j,Xj+\) :j > 0) is a sequence of i.i.d. 
random pairs. 

(i) If u*(x) = P(M 00 > x), then u* = (u*(x) : x € M) satisfies the linear 
integral equation 

u = b + Tu, 

where b = (b(x) : x > 0) is given by b(x) = P(^o > x) . 

(ii) Furthermore, u* is given by 

oo 

(2.3) u* = T n b. 

n=0 

The proof is similar in spirit to that for the unperturbed case discussed 
in [6]. There is one special case for which we have been able to derive a 
closed form expression for u. 

Proposition 4. Suppose that (—Xj-.j > 1) is a sequence of i.i.d. 
exponential A) random variables, independent of the i.i.d. perturbation se- 
quence (£j :j > 0). Then, 

P(M oc <x)= P(£o < a;) exp (-A P(£o > y) dy 

for iSl. 
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Because we are generally unable to solve for the distribution of = 
max{S n +£ n : n > 0} exactly, we shall instead satisfy ourselves with obtaining 
approximations for the tail probability P(Moo > x). In [2], we obtain heavy- 
traffic diffusion approximations for this tail probability when the mean of the 
underlying random walk is negative but close to zero. In the current paper, 
we focus on studying the asymptotics of P(Moo > x) for x large (when the 
mean of the random walk need not be close to zero). 

3. Tail asymptotics for light-tailed perturbations. In this section we 
shall focus on the case in which the behavior of P(Moo > x) for large x 
is primarily determined by the distribution of the random walk (as opposed 
to the perturbations). Specifically, we shall be interested in studying condi- 
tions on the perturbed random walk under which the tail of Mqo satisfies a 
Cramer-Lundberg asymptotic of the form 

(3.1) P(Moo > x) ~ cexp(-0V) 

as x — > co, where the rate constant 9* agrees with that associated with the 
tail of the maximum of the unperturbed random walk as described through 
the conventional Cramer-Lundberg asymptotic; see, for example, [3] for a 
discussion of the relevant theory for unperturbed random walk. We refer to 
this setting as the "light-tailed" perturbation case. 

Note that P(Moo > x) > P(£o > x). Hence, if there exist positive constants 
d and v such that 

(3.2) P(£j > x) ~ dexp(-ux) 

as x — > co, it follows that the validity of (3.1) requires that v > 0*. It follows 
that if the f/s satisfy (3.2) with v > 9*, then Eexp(0fj) < co for 9 < 9*. 
In the remainder of this section, we make the (slightly) stronger hypothesis 
that Eexp(0£j) < co for 9 in a neighborhood of 9* . 

Condition A2. (Xj : j > 1) is an i.i.d. sequence of random variables for 
which there exist positive constants 9* and e such that Eexp(#Xi) < co for 
\6 - 0*| < £ and Eexp(0*Xi) = 1. 

It is well known that if the AVs are nonlattice, then Condition A2 ensures 
that the exact asymptotic 

(3.3) P(max5„ >x j ~rexp(-0*x) 

V n >o J 

as x — > co (for some positive r) holds for the maximum of the unperturbed 
random walk; see, for example, [3]. This, of course, is precisely the Cramer- 
Lundberg asymptotic for the (unperturbed) random walk (S n :n> 0). 
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A key idea in extending the exact asymptotic (3.3) to the context of 
perturbed random walk is the use of "change-of-measure" techniques. In 
particular, let P* be the probability on the path space of the (Xj, £j)'s under 
which the X,-'s are i.i.d. random variables with common distribution given 
by 

F*(Xj G dx) = exp{6*x)F(Xj e dx). 

If E*(-) is the expectation operator corresponding to P*, and following a 
similar argument than in the unperturbed case (see [3]), we have that 

(3.4) exp(e*x)F(M 00 >x)=E*exp(-e*(S T{x) -x)), 

where T = T(x) = inf{n >0:S n + £ n >x}<oo P*-a.s. 

Exact asymptotics for P(M 00 > x) may therefore be deduced by studying 
the distribution of St( x ) ~ x under P* for large values of x. In contrast 
to the corresponding analysis for unperturbed random walk, there is no 
guarantee here that <St(x) ~~ x wm be positive or that T{x) will correspond 
to a ladder epoch of (S n : n > 0). As a consequence, the analysis of St( x ) ~ x 
under P* is more intricate than in the setting of standard random walk. One 
approach to the analysis of <S>V(z) ~~ x involves the use of renewal-theory ideas. 
For unperturbed random walk, the process (St( x ) — x - x >0) is precisely 
the "current age" process corresponding to a renewal process in which the 
increments are governed by the strictly ascending ladder height of (S n : n > 
0) under P*. However, in the setting of perturbed random walk, (Sj>( x ) — 
x:x>0) is not even a Markov process. Markov structure can be obtained by 
adding a supplementary state variable such as max 0< j <T ^(Sj + — x. This 
two-dimensional Markov structure complicates the application of renewal 
theoretic ideas. 

One setting in which one can directly apply such renewal-theoretic con- 
cepts is when the Xj's are unbounded above while the £j's are upper bounded. 

Theorem 1. Suppose that either: 

(i) :j > 0) is a sequence of i.i.d. random vectors or 

(ii) (Xj : j > 1) is a sequence of i.i.d. random variables that is indepen- 
dent of the stationary sequence (£,• :j>0). 

Assume, in either case, that Condition A2 holds and that X\ has a nonlattice 
distribution. Suppose, in addition, that there exists cq < oo such that P(A"i > 
Co) > and P(£o < c o) = 1- Then, there exists a positive constant c such that 

(3.5) P(Afoo > x) ~ cexp(-6*x) 
as x — > oo. 
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PROOF. Set r+(0) = and let r+(n) = inf{j > r+(n - 1) : Sj > 5 T+ ( n _i)} 
be the nth strict ascending ladder height epoch of (S& : A; > 0) . In addition, 
set <j(0) = and let ?(n) = inf{j : 5j > Sk + Co; j > k > s(n — 1)} be the nth 
strict ascending ladder epoch at which the ladder height increment is greater 
than Co- Observe that = T + (rj), where rj = inf{j > 1 : S T ,u\ — S T + (j-i) > 
Co}. The random variable r] is geometric, with mass function 

F *( v = l) = F*(S T+(1) >c )P*(5 r+{1) <c ) l -\ 

But, 

P*(S T+{1) > c ) > P*(S T+(1) > c ,r+(l) = 1) = F*(X 1 > c ) > 0, 

and consequently E*r/ < oo, so that ?(1) < oo a.s. The key characteristic 
of is that T(5 ? (i)) > ?(1). To see this, note that S^m > Sj + Co for 
< j < Hence, S^i) > + for < j < <?(1), so that T(y) > for 

y > 5 g (i)- Put 

u(x) = E* exp(— 9*{Sx( x ) ~ x )) 

and 

6(x) = IE* ex P (-0* (5 TW - x))7(5 f(1) > x). 

Then, 

b(x) + J*E*exp(-e*(S Tix) -x))I(S, {1) € dy) 



U\X) 



rx / oo 

6(z) + / E* exp -0* ]T (5j - x)/(S' i + ^ 

V 7=cfl) 



.„ > x, 
x J(S f(1) G dy) 

/ CO 

+ / E *exp -0*^(5 ?(1)+ ,--^ (1) -(x-y)) 
Jo V j=0 

x - 5 ?(1 ) + >x-y, 

S g (i) +jfc + ^(i)+fc < a;, & < i) 

x /(5 f( i) e dy) 
6(x)+ / u(x -y)F q (dy), 
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where F^dx) = P*(5 c (i) < x). The fact that ?(1) < T{x) on {S q(l) < x} 
was used in the second equality above, whereas the independence between 
(£ n , (, n +i, ■ ■ •) and S n (together with the stationarity of the £j's) provides the 
third equality. [Note that the required independence and stationarity hold 
under either hypothesis (i) or (ii) of the theorem.] 

It remains only to apply Feller's version of the renewal theorem to the 
above renewal equation. First, observe that because X\ is nonlattice, 
P*(S' r+( - 1 ) e •) is nonlattice; see page 222 of [3]. For the integrability of £>(•), 
we use the fact that St( x ) + €t(x) > x i so that —0*(St( x \ — x) = —0*(St( x ) + 
€t(x) ~ x ) + @*£,T(x) — #*co- Consequently, Wald's identity implies that 

roc 

J b(x)dx<e e * c °E*S, {1) 

= e e ' Co E*i]E*S T+{1) <oo. 

The final step is to prove that &(•) is directly Riemann integrable. The sample 
paths of (St( x ) — x:x>0) are right continuous with left limits everywhere. 
Because exp(— 6*(St( x ) —%)) < exp(#*co), the bounded convergence theorem 
implies that b(-) is also right continuous with left limits. It follows that £>(•) 
has at most countably many discontinuities; see page 116 of [5]. Owing to 
the bound b(x) < exp(^*co)P*(5' ? ( 1 ) > x) and Proposition 5.4.1 of [3], we may 
therefore conclude that &(•) is directly integrable, proving the theorem. □ 

Assumption (i) of Theorem 1 allows some dependency between the ran- 
dom walk and the perturbation. However, the conclusion of Theorem 1 gen- 
erally does not hold if we assume only that the perturbation is light-tailed 
with Eexp(#£j) < oo for 6 in a neighborhood of 6*; additional regularity, as 
presumed in Theorem 1, is needed. To see this, suppose that Xi = Ri — Ri 
for i > 1, where (Ri : i > 1) and {Ri : i > 1) are independent sequences of i.i.d. 
exponentially distributed random variables, with parameters Ai and A2, re- 
spectively. Choose A2 = Ai/4 and let 6* = X\ — A2 = 3Ai/4. Suppose that the 
£i's are correlated with the random walk. In particular, if £j = Ri for i > 1, 
then Mqo > 2i?i — R±. In this case 2Ri — R\ has an exponential right tail 
with parameter Ai/2. Consequently, has a tail that can decrease no 
more quickly than exponentially with rate constant Ai/2, which is heavier 
than that predicted by Theorem 1. 

When the £j's are independent of the unperturbed random walk [as in 
assumption (ii) of Theorem 1], and the random walk has spread-out incre- 
ments, we can remove the boundedness assumption on the perturbations. 
To deal with the complications that arise here, we use a proof based on 
coupling ideas. Before stating the main result of this paper, we prove the 
following lemma related to the general theory of unperturbed random walk 
(that we have been unable to find in the existing literature): 
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Lemma 1. Consider a random walk with an i.i.d. sequence of increments 
(X n : n > 0), in which < EXi < oo. The increment X\ of the random walk 
is spread- out if and only if the increment of the ascending ladder height 
S T+ m is spread-out. 

Proof. Let F be the distribution of X\ and F + the distribution of 
S T+ (\). Let N(x) = infjra > 0:S n > x}. Assume first that F is spread-out. 
Hence there exists n > such that the distribution of S n admits a den- 
sity component. For z > and e > 0, form the random variables Y\ = 
S\zis\l{X x < -e,X 2 < X [z/£i < -e) and Y 2 = (S n+ [_ z / e j - 5^/ £ j) x 

J(maxo< :7 <n('%+|z/Ej — S\zle\) — z )- F° r sufficiently large z, the random vari- 
able Y2 = S n I (maxo< j< n Sj < z) admits a density component and, hence, the 
sum Y\ + Y2 does as well. Finally, by writing 

(3.6) P(5 r+(1) < b) > f° ¥(Y 1 + Y 2 e dx)F(S N( _ x) < b) 

for all b > 0, we conclude that F + admits a density component. For the 
converse, suppose that F is not spread-out. Then, F™ is concentrated on a 
null Lebesgue set for all n. Since P(5 T+ (i) G -,t+(1) = k) = F(S k G -,r + (l) = 
< F* k (-), evidently F + is also concentrated on a null Lebesgue set. A 
similar argument establishes that Fl n is also concentrated on a null Lebesgue 
set for all n. □ 

Our next theorem generalizes part (ii) of Theorem 1 [but not part (i)]. 

Theorem 2. Assume that (Xj :j>l) satisfies Condition A2. Suppose 
that (£j :j > 0) is a stationary sequence independent of (Xj : j > 1), for which 
Eexp(0^) < 00 for 6 in a neighborhood of 9* . If X\ is spread-out, then there 
exists a positive constant c such that 

P(Afoo >x)~cexp(-6*x) 

as x — > 00 . 

Proof. In contrast to the proof of Theorem 1, our proof here proceeds 
via a coupling construction (see, e.g., [20]). We construct a doubly-infinite 
stationary version of (S n : n > 0), calling it (S* : —00 < n < 00), and random 
times o\ and 02, for which S ai+ k = S* 2+k for k > 0. The process (S* : —00 < 
n < 00) is stationary in the sense that for each x G R, 

(3.7) (Sn*(x)+j ~ x '■ -°° < J < 00) = (5* : -00 < j < 00), 

where N*(x) = inf{n > : S* > x}. We then extend the stationary sequence 
(€j : J > 0) to a doubly-infinite stationary sequence and set T*(x) = inf {n : 5* + 
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£ n > x}. The proof concludes by showing that T*{x) = T(x), for x sufficiently 
large, and that S^,^ — x = S 1 ^*^)- It follows that 

St(x) — x ^ 5^* 

as x — > oo. In the presence of uniform integrability of (exp(— 0*{Sx( x ) ~ x )) '■ 
x > 0) under ¥*, we then obtain, recalling equation (3.4), the conclusions 
of the theorem. Note that both iV*(-) and T*(-) depend on the indexing of 
the points in the set (S* : — oo < n < oo). It is therefore essential that our 
construction of (S* : — oo < n < oo) produces point indexing that respects 
the stationarity relation (3.7) [rather than the weaker stationarity relation 

(S* : -oo < n < oo) = (S* + x : -oo < n < oo)]. 

We start by using the conventional coupling for finite mean renewal pro- 
cesses with spread-out increment distribution to couple the ascending ladder 
heights (which is enabled by Lemma 1). Specifically, we couple {S T ha : k > 0) 
to a stationary version (U k : — oo < k < oo) of the strictly ascending ladder 
height sequence, thereby constructing a pair of random times r\\ and 772 
for which 5' T+ (^ 1 +fe) = U* +k for k > 0; see, for example, [14]. Set 5g = Uq . 
Conditional on (UJ : —00 < j < 772)) condition in the ladder height epochs 
{r+(j) ■ j < m) so that S** +(J) = U* for j < 772 . Finally, given (5;, (j) ,r^(j) : j < 
772)5 generate (S* :n < 14(772)) from the corresponding conditional distribu- 
tion and set S* +k = S a2+k for k > 0, where o\ = 14(771) and 02 = 14.(772). 
The above construction couples (S n : n > 0) to (S* : —00 <n< 00) and yields 
a process (S* : — 00 < n < 00) that is stationary in the sense of (3.7); see 
[1] for additional details. Turning now to the analysis of T*{x), observe 
that T*(x) > -00, since (S* + £+)/n ~* < P*-a.s. asm -00, so 

that (at most) finitely many of the (Sj + ^j'-j <0) can exceed x. Since 
5* + — > +00 P*-a.s. asm +00, it follows that T*(x) is finite- valued for 
all x. Furthermore, S^*^) — x = Swgy To see this, note that 

St*{x) ~ x 
00 

= Y, (S* k -x)I(S* k +Z k >x,S* + ^<x,j<k) 

k=—oo 
oo 

l=—oo 

X I{Sn*( x ) + i + £,N*(x)+l > S'iV-*(a;)+j + £iV*(a;)+j <%,j < 

oo 

= H (S* N , {x)+l -x)I(S* N , {x)+l + ^i>x,S* N , {x)+j +C j <x,j <l) 

l=—oo 
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oo 

^ SfI(Sf + ^>x,S* + ^<x,j<l) 

1= — OO 

Q* 

— O r .( ). 

To obtain the first distributional equality, we use the stationarity and in- 
dependence of the £j's from the 5 n 's and S^'s. The second distributional 
equality is a consequence of (3.7). 

We now show that Sx( x ) — x = S^„/ x \ — x for x sufficiently large. This 
follows easily from the fact that T(x) — ► +oo and T*(x) — > +oo P*-a.s. as 
a; — > oo. This implies that S^z) = S£w z n for sufficiently large x so that 
T{x) > «Ti and T*(x) > 02 • Finally, the required uniform integrability follows 
from Proposition 6 below. □ 

We conclude this section with a couple of bounds for P(M 0O > x). We note 
that both the lower bound and upper bound are multiples of exp(— 6*x) and 
consequently are within a constant factor of the correct value of P(M 00 > x) 
uniformly in x. 

Proposition 5. Suppose that (£j :j>0) is a stationary sequence inde- 
pendent of (S n : n > 0) . Then, 

P(M QO >x)> [ p(maxS n >x- y)v($ € dy). 

JR V n>0 J 

If, in addition, (2>.2>) holds with Eexp(^*^o) < oo, then 
liminf e^^PfMoo > x) > rEexp(6>*£ ). 

x— >oo 

Proof. Let J be the time at which the random walk attains its all- 
time maximum and note that both J and Sj are independent of (£ n :n > 0). 
Clearly, > 5j + £j, so 

/•oo 

P(M oc >x)> F(Sj + O > = y)F(Sj € dy) 
Jo 

/•oo 

= / P(£o > x - y)P(5j € dy) 

= / F(Sj>x-y)P(Zo£dy). 
Jr 

For the second conclusion, note that 

e e ' x [ ¥(Sj >x- y)P(£ € dy) 

JR 
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Applying (3.3) [and noting that it implies that exp(#*(x — y))P(max n >o S n > 
x — y) is uniformly bounded in x and y], the hypothesis Eexp(#*£o) < oo 
permits the dominated convergence theorem to be invoked, yielding the 
result. □ 

PROPOSITION 6. Assume Condition A2 and let k G (0, 9*) satisfy iJ/(k) = 
0. Suppose that (£j : j > 0) is a stationary sequence, independent of (S n : n > 
0), for which Eexp(#£i) < oo in a neighborhood of 9*. Then, for 9 in a 
neighborhood of 9* , 

limsupE* exp(— 9(St( x ) ~ x )) 

1 ^, , ( Eexp((9Ci) \ 

Proof. Set v(x) = E* exp(-6'(5 T ( x .) - x)) and note that 
v{x) = E* exp(-9(S T{x) - x))I{T{x) < r+(l)) 
(3.8) + E* exp(-9(S T{x) - x))/(5 T+(1) > x, T(x) > r + (l)) 

+ E* exp(-9(S T(x) - x))I(S T+{1) < x, T(x) > r+(l)). 
Set k{x) = k\{x) + k 2 {x), where 

k 1 (x)=E*exp(-9(S T(x) - x))I(T(x) < r+(l)) 

k 2 (x) = E* exp(-9(S T(x) - x))I(S T+{1) > x,T(x) > r+(l)). 

The third term on the right-hand side of (3.8) can be written as 

00 

E* exp(-9(S n+T+{1) - x)) 

n=0 

x I(S j+T+w + £j+r + (l) < x, < j < n, 5 n+r+( i) + ^ n+r+ (i) > x) 
xI(T(x)>T+(l),S T+il) <x) 

- 51 / E * ^PC-^C^n+r+Ci) ~ ^+(1) - (a; - y))) 

n=0 J (M 

x I(S j+T+{1) - S T+{1) + £j+T + (i) < x - y, < j < n, 

Sn+r + (l) - S T+ (1) + £,n+T + (l) > X - y) 

x I(S T+{1) G dy) 
= [ v(x-y)F*(S T+[1) edy), 
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where the independence and the stationarity of the perturbations and the 
random walk was used for the equality. Hence, 

(3.9) v < k + F + * v, 

where * denotes convolution and F + (dx) = ¥*(S T+ ^ G dx) for x > 0. Iterat- 
ing (3.9) n times, we find that 

n 

(3.10) v < J2 F + ] * k + ^+ n+1) * v > 

j=0 

where denotes the j-fold convolution of F+. But (i^i™ *v)(x) = K*v(x — 
S T+ r n \), and v (•) is bounded on [0,x]. To verify the boundedness, note that, 
for p > 0, 

E*exp(-9S T(x) ) 

oo 

< 53 E* exp(-9S n )I(S n + £ n >x) 

n=0 

oo 



= 53 / E*[exp(-0S n );5 n >s-y]P(£iedy) 

oo „ 

= 53 / E[exp{(6*-6)S n y,l3S n >0(x-v)]V(Ziedy) 

oo ,. 

<53 / E[exp((e*-e + P)S n )}exp(-Px + Py)¥^ 1 Edy) 



= exp^^Eexp^i) 53(Eexp((r - + /3)Xi) n ), 

n=0 

which can be made convergent by choosing 9 > > 9 — 9* . Given the bound- 
edness, it follows that (F( n ) * v)(x) — > as n — > oo and, hence, 

t> < [/+ * k, 

where U+ = Y^j=o ^+ * s the renewal kernel associated with the distribution 
F + . To apply Smith's version of the renewal theorem (see, e.g., page 187 of 
[3]) we now need to verify that k\ and k^ are dominated by nonincreasing 
integrable functions. For k\, observe that 

h(x) < E* exp(-9(S T{x) + ^ (x) -x) + 9i T{x) )I(T(x) < r+(l)) 

<E*exp(^ T(x) )J(r(x)<r + (l)) 

< E* exp f 9 max £ ) i| max (Si +£i) > x ) 

V 0<j<r + (l) 3 J \0<j<r + (iy J J ' J 
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max £ 7 - > x J dx 

0<j<T+(l) 



< E* exp ( 9 max £j ) / ( max £ 7 - > x ) , 

V 0<j<r+(l) V Vo<j<r + (i) / 

where the last inequality uses the fact that Sj < for j < t+(1). Hence, &i 
is dominated by a nondecreasing function for which 

/"°°E*exp|0 max 
Vo V o<i<r+(i) V V 

= E* max fjexp(^) 

0<J<-r+(l) 
r+(l)-l 

(3.11) <E* ^ Ciexp(^i) 

j=0 

= EV+(1)-E*6exp(^ 1 ) 

= E*T+(1)-Efiexp(0fi) <oo, 

where the second last equality follows from Wald's identity, and the final 
equality utilizes the fact that the £j's have the same distribution under P as 
under P*. As for the function note that 

k 2 (x) =E*exp(-6»(S , T (x) -x))I(S T+ ^ >x,T(x) > r+(l), 5 T(a .) > x) 

+ E*exp(-6»(S' T(:C ) -x))/(5 T+(1) >x,T(x) > r+(l), 5 T(2 .) < x) 

< P*(S r+{1) > x,T(x) > t + (1),S t(x) > x) 

(3.12) 

+ E*exp(0£ T(:E ))I(S , r+ ( 1 ) >x,T(x) >t+(1),S T ( x ) < x ) 
<¥*(S T+(1) >x) 

+ E* exp(^ T ( a . ) )/(5 T+( i ) >x,T(x) > r+(l), 5 T(a; ) <x). 
The second term on the right-hand side of (3.12) is dominated by 

oo 

X>*exp(0£ r+(1 ) + n) 



n=0 



X ^"(^+(1) > X i T ( X ) = T +(!) + n > S T+{ l)+n ~ 5 T+ (i) < 0) 
oo 

< E* exp(^ 1 ) £ E*I(S T+(1) > x, = r+(l) + n, 

n=0 

S T+ (l)+n - St+(1) < 0) 

oo 

< Ee X p(^i)P*(5 r+(1) > x) V*(S n < 0) 

n=0 

oo 

= Eexp(0£i)P*(S r+(1) > x)Y;Kexp(9*S n )I(S n < 0) 



n=0 
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< 



Eexp(0fi)P*(S T+(1) > x) Eexp( K 5 n ) 



n=0 



= Ee*p(0£ 1 )P*(S T+(1) > x)(l - exp^(K)))- 1 , 

from which the result follows immediately via an invocation of Smith's re- 
newal theorem. □ 



Remark 1. If the £j's satisfy the conditions of Proposition 6 and are, 
in addition, nonnegative, then T(x) = t + (1) on {S T n\ > x,T(x) > r+(l)}. 
It follows, in this case, that k2(x) < E*exp(— 9(S T+ n\ — x))I(S T+ ^ > x), so 
the upper bound 

limsupE* exp(— 6(St( x ) ~ x )) 

x-+oo 

(3-13) <^yE6ex P (06) 



+ — i E* f ST+<1> eM-0(S T+{1) -x))dx 



holds. 



When 9 = 9* , we note that the second term on the right-hand side of (3.13) 
is then the Cramer-Lundberg constant r for the unperturbed random walk. 
Hence, both our upper and lower bounds can be expressed directly in terms 
of r and 6*. 



4. Tail asymptotics for heavy-tailed perturbations. In this section we 
develop a couple of tail asymptotics for in which the perturbations have 
a sufficiently heavy right tail that they largely govern the behavior of M^'s 
tail. We first consider the setting in which the £j's have an exponential-like 
right tail, for which Eexp(#*£i) = oo. 



Theorem 3. Assume that > 0) is a sequence of i.i.d. random 

variables satisfying (3.2). Suppose also that (Xj'.j > 1) is a sequence of 
i.i.d. random variables, independent o/(£j :j > 0), for which'Eexp(i>Xi) < 1. 
Then, 

P(Moo > x) ~ d{l - Eexp(^Xi))~ 1 exp(-ra) 



as x — > oo . 



MAXIMUM OF PERTURBED RANDOM WALK 



17 



Proof. We start by observing that S n — > — oo a.s. by the strong law of 
large numbers. In addition, Markov's inequality yields 



' max 



oo 

ns n >x) 

n=Q 

oo 

= e~ ux E J2 exp(uS n )I(S n > x). 

n=0 

But J2n°=o ^ x P{ l/ S n )I(S n > %) — > a.s. as x — > +00, and X)^Lo ex P( i/ 'S'n) nas 
expectation (1 — Eexp(i/A"i)) _1 < oo. So, the dominated convergence theo- 
rem proves that P(max n >o S n > x) = o(e~ ux ) as x — > oo. 
By conditioning on (Sj : j > 0), we find that 

P(Moo < a?) = Eexp^f>g(l - F 5 (x - S^J . 

Fix e > and choose A large enough so that 

-(1 + e)Ft(x) < log(l - Ffc)) < -(1 - e)F((x) 
for x > A. Then, on {max n >o S n < x — A}, x — Sj > A for all j > 0, so that 

oo oo 

- (1 + e) J2 Ffc ~ S i) < E Ml " fyx - Sj)) 

3=0 j=0 

OO 

<-(l_ e )^F f (x-^). 
i=o 

Observe that, because F^(x) < c?oexp(— i/x) for x > (and some finite con- 
stant do), 

oo oo 

^F^(x — Sj) < dp exp(— ux) exp(ySj). 

3=0 3=0 

But Y^jLo^Pi^Sj) ^ s integrable, so Z)ylo ex P( y ^j) < 00 a - s - Hence, 
Z)j^=o^( x ~~ = 0(e _ra ) — ► a.s. as x — ► oo. As a consequence, 

e-^l-exp^-a-e)^^-^)^ 

oo 

= e ra (l-e)^F 5 (x-S' i ) + o(l) a.s. 

3=0 
oo 

— ► (1 — exp(^S'j) a.s. 

j=0 
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as x — > oo. A similar argument holds for the lower bound in (4.1). Since e > 
was arbitrary, this proves that 

e ra ( 1 - exp( f>g(l - F^x - Sj))) J ->■ df^exp(uSj) a.s. 

as x — > oo. 

To complete the proof, we need to show that we can invoke the dominated 
convergence theorem. This follows from 

e-^l-exp^loga-F^x-^))^ 

< e ux I(M > x - A) + e vx |l - exp ^-(1 + e) f] F^x - Sj)^ ^ 

oo 

< e ™ . e - V (x-A) e „M + e ux^ + £ )Y^ F^X - Sj) 

3=0 

oo oo 

< e uA eM"Sj) + (1 + e)do ex P("Sj), 

3=0 3=0 

which, as argued earlier, has finite expectation. [The elementary bound 
exp(— y) > 1 — y, for y > 0, was used to obtain the second inequality above.] 
□ 

Note that the constant (1 — Eexp(z^Xi)) -1 depends on the distribution 
of the increments of the random walk through an exponential moment. Our 
second "heavy-tailed perturbation" asymptotic shows that when the pertur- 
bations have a heavier tail than that described in Theorem 6, the distribution 
of X\ affects the asymptotic only through its (ordinary) mean. 

Condition A3. (Xj : j > 1) is an i.i.d. sequence of random variables for 
which there exists e > such that Eexp(e|Xi|) < oo and EXi < 0. 

In our next theorem, we assume that the perturbations have a hazard 
rate that decreases to zero. This assumption is one way of describing "heavy 
tails." In particular, all Pareto random variables, as well as all Weibulls 
random variables with shape parameter strictly less than one, obey this 
hazard rate hypothesis. 

Theorem 4. Assume Condition A3. Suppose that > 0) is a se- 

quence, independent of (Sj :j > 0), of i.i.d. random variables having a con- 
tinuous hazard rate function h(-) such that h(x) — > as x — > oo. Then, 



l r°° 

P(M 00 > x) ~ — — J P(6 > y) dy 
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as x — > oo . 



PROOF. Set R(x) = F^(y)dy. Recalling that h(x) — » and 

(4.2) ^(x + y) = ^ p /_ rv + \ ^ i 

i^Cx) \ io / 

as x — > oo, one can easily prove that 

(4.3) R{x) / R{x + y) -> I 

as x — > oo. Recall that S^/n — » /x a.s. as n — > oo and observe that Condi- 
tion A3 implies that, for e > and sufficiently small, there exists 8 > such 
that 

(4.4) P(|5„ - n/Jt\ > en) = 0{e~ &n ); 

see page 18 of [4], for example. The Boreb-Cantelli lemma therefore shows 
that \S n — nu\ > en almost surely occurs only finitely often. 

Fix e > and note that L(e) = sup{n > 0: \S n — nu\ > en} is therefore 
finite- valued. We may thus write 

oo L(e) oo 

Y^f ( (x-s,) = J2f ( (x-s ] )+ £ fy*-Sj) 

3=0 3=0 3=L(e)+l 

(4.5) <(L(e) + l)F ? fx-max5 n ) + F ( (x - uj - ej) 

V ™>0 1 — 



j=L(e)+l 



< (L(e) + l)F $ (x-max5 n ) 
V n >o J 



1 ~ rx-<Ji+£)3 

+ T77X7T E / F dv)dy 



P + E \ j= i& +1 J*-0*e)U-l) 

(Lie) + 1)fA x -maxS„ ] + 1 — tR(x - (u + e)L(e)) 

\ n>o J \n + e\ 



R(x)+o(R(x)) a.s. 



\u + e 

as x — > oo, where (4.2) to (4.4) are exploited for the final equality above. 
Since 

1 1 / 00 - \ 

(46) P(M °° > X) = E R(x~) I 1 " 6XP E ln (! - ^ " ^)) ) • 



j=0 
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we focus on the random variable appearing on the right-hand side of (4.6). 
Equation (4.1) and (4.5) permit us to conclude that 

if 00 - \ 1 

limsup p7-r 1-exp 5^111(1-^(0;-^)) < j— - a.s. 

A similar lower bound for the limit infimum holds. Since e > can be chosen 
arbitrarily small, we find that 

1 / 00 \ 1 

(4.7) _^-ex P gm(l-*' 5 (x-S,))j^ R a.s. 

asu 00. 

To complete the proof, it remains only to show that the left-hand side 
of (4.7) is uniformly integrable. Note that 

J-j (1 - expgmd - F (i x - s,») = J-j (1 - flu - j%(x - m) ■ 

For < a,i < 1, i > 0, an easy induction on n shows that 1 — nr=o(l ~~ a i) — 
J27=o a i anc ^! hence, the left-hand side is dominated by 



< —. - 1 1 max S n > x/2 

~ R(x) \n>0 1 



1 

+ 



R(x 

(4.8) + 



(L(e ) + I) Ft [ x - max5 n I 
R(x-(n + e )L(e )) 



■ l[ maxSn < x/2 



< exp f — Eqx/2 + eo max / f max 5 n > x/2] 

R(x) \ n>0 J \ n>0 J 

+ \ (-k( £ o) + l)-^f (2; - max S n ) I ( max S n > x/2) + l/l/j, + e | 

. exp(— Sqx/2) ( \ . 

< ^7^ exp £ max\ + 1/ /i + e 

it(x) V n >° / 

+ (L(e ) + l)expfr /i(u)du) • /fmax5 n < §^ 

\7x-max n > 5„ / \™>0 / i?(x) 

^ exp(— Eqx/2) ( \ 

< exp £ max6 n + 1/ /i + e 

it(x) \ n>0 / 

/ \ Ft(y) 

+ (i(eo) + 1) exp sup{/t(y) : y > :r/2} • max5 n • max , 
V n >° / y>° R{y) 
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for eo > 0. But exp(— eqx/2)/R{x) = exp(— J x (eq/2 — h(u)) du) — > as x — > 
oo. It follows from (4.8) that the required uniform integrability of the left- 
hand side of (4.7) is a consequence of the Cauchy-Schwarz inequality and 
that 

(4.9) E exp I 2eo max S n ) < oo and EL(eo) 4 < oo 

for some eo > 0. But exp(2emax n >o S n ) < J2n°=o ex -P( £ ^n)- Since ijj'(0) < 0, 
there exists 9 > such that ip{9) < 0. Condition A3 then ensures that 
E^^Lo ex P(^^) < oo- To deal with L(eo), note that 

L(e) oo 

L{ef < ^ fm - Mil > ej) < £ //(|^ - M j| > ej). 

3=0 3=0 

But (4.4) ensures that P(|Sj- — fij\ > ej) decays exponentially in n, proving 
the finiteness of EL(e) 4 . By choosing sq sufficiently small so that < eo < 8 
and EL(eo) 4 < oo, we obtain (4.9), completing the proof. □ 
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